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Abstract 

The Douglas-Rachford algorithm is a simple yet effective method for solving convex 
feasibilify problems. However, if fhe underlying consfrainfs are inconsisfenf, fhen fhe 
convergence fheory is incomplefe. We provide convergence resulfs when one consfrainf 
is an affine subspace. As a consequence, we exfend a resulf by Spingarn from halfspaces 
fo general closed convex sefs admiffing leasf-squares solufions. 
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1 Introduction 


We shall assume throughout this paper that X is a real Hilbert space with inner product (•, •) 
and induced norm || • ||, and that 

A and B are nonempty closed convex (not necessarily intersecting) subsets of X. (1) 

Consider the problem of finding a best approximation pair relative to A and B (see O, 1^), 
that is to 

find (a,b)^AxB such that ||fl — &|| = inf ||A — B||. (2) 
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Recall that the Douglas-Rachford splitting operator [Sj for the ordered pair of sets {A,B) is 
defined by 

T = T(a,b) ■= 2 (Id +RbRa) = Id -Pa + PbRa, (3) 

where Pa is the projector onto A and Ra ■= 2Pa — Id is the reflector onto A. Let x G X. In 
the consistent case, when Za,b ■= A DB ^ 0, the "governing sequence" generated 

by iterating the Douglas-Rachford operator converges weakly to a fixed poinlj^of T (see f8l), 
and the "shadow sequence" {PAT^x)neN converges weakly to a point in A n B (see lll^ or O 
Theorem 25.6]). For further information on the Douglas-Rachford algorithm (DRA), see also 
[181 and [16]. 

In ||3l, the authors showed that in the inconsistent case, when A n B = 0, {PAT"x)„fz^ 
remains bounded with the weak cluster points of {PaT^x, being best approx¬ 

imation pairs relative to A and B whenever g := Pg^^O G B — A. The goal of this paper is to 
study the case when A n B is possibly empty in the setting that one of the sets A and B is a closed 
affine subspace of X. Our results show that the shadow sequence will always converge to 
a best approximation solution in A n (B — g). As a consequence we obtain a far-reaching 
refinement of Spingarn's splitting method introduced in lITTl . 


2 Main results 


We start with the following key lemma, which is well known when A = X. 

Lemma 2.1. Let Abe a closed linear subspace of X, let Cbe a nonempty closed convex subset of A, 
and let (Xn)n6N be a sequence in X. Suppose that (Xn)n6N Fejer monotone with respect to C, i.e., 
(Vn G N) (Vc G C) ||x„+i — c|| < \\x„ — c\\, and that all its weak cluster points of {PAXn)nef^ 
in C. Then {PAXn)neK converges weakly to some point in C. 

Proof Since {x„)„(zj^ is bounded (by e.g., |12[ Proposition 5.4(i)]) and Pa is (firmly) nonexpan- 
sive we learn that {PAXn)nef^ is bounded and by assumption, its weak cluster points lie in 
CCA. Now let Cl and C 2 be in C. On the one hand the Fejer monotonicity of (x„)„g]N implies 
the convergence of the sequences {\\x„ — Ci|p)„g]N and (||x„ — C 2 |p)n 6 ]N by e.g., lH Proposi¬ 
tion 5.4(ii)]. On the other hand, expanding and simplifying yield \\x„ — Cip — \\xn — C 2 p = 
\\x„\f -6 ||ci||2 - 2{xn,Ci) - \\x„\\^ - \\C 2 \\^ + 2{xn,C2) ^ ||ci|p - 2(x,„Ci - C 2 ) - ||c 2 |p, which 
in turn implies that {{x„,Ci — C 2 ))neK converges. Since Ci G A and C 2 G A we have 


{x„,Ci - C2) = {x„,PaCi - PaC2) = (x„,Pa(Ci - C2)) = {PAXn,Ci - C2) ■ ( 4 ) 

Now assume that {PAXk,f)nen srid (PA^/„)n6N are subsequences of {PAXn)neK such that 
PAXkn Cl and PaXi„ C 2 - By the uniqueness of the limit in Q we conclude that 
(ci,ci — C 2 ) = (c 2 ,ci — C 2 ) or equivalently ||ci — C 2 IP = 0, hence {PAXn)net^ has a unique 
weak cluster point which completes the proof. ■ 

^Fix T={xeX\x = Tx} is the set of fixed points of T. 
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From now on we work under the assumption that 


g — S(A,B) ■— e B - A. (5) 

In view of (|^ we have 

£ = ■E(a,b) := (B -^) 7^ 0 and F = F(^ g) := (A + ^) n B 7^ 0. (6) 

For sufficient conditions on when g ^ B — A (or equivalently the sets E and F are nonempty) 
we refer the reader to lU Facts 5.1]. 

Lemma 2.2. Let x G X. Then the following hold: 


(i) IfCe {A,B} is a closed affine subspace ofX, then g E {C — C)^. 

(ii) The sequence (T”x — n^)n6]N is Fejer monotone with respect to E. 

(iii) The sequence is bounded and its weak cluster points lie in E. 

(iv) If B is a closed affine subspace, then PbT"x — PaT"x —> g, the sequence (BB’B"x),;g]N is 
bounded and all weak cluster points lie in F. 

(v) IfE = {x} and hence F = {x + g}, then PaT^x x and PbT^x ^ x + g. 


Proof. See lU Corollary 2.7 and Remark 2.8(ii)]. (ii) It follow^from lH Theorem 3.5] that 
E + N^{-g) C Fix(-^ + T) := {x G X | x = -^ + Tx} C -g + E + N^{-g). Con¬ 
sequently, E C Fix(—^ + T). Moreover, fS] Remark 3.15] implies that the sequence (T”x — 
ng)„g]N is Fejer monotone with respect to Fix(—^ + T). (iii) See ]j3j Theorem 3.13(iii)(b)]. (iv) 


See in Theorem 3.17]. |(v)[ This follows from ](iii)'] and |(iv) 


We are now ready for our main results. 

Theorem 2.3 (convergence of DRA when A is a closed affine subspace). Suppose that A is a 
closed affine subspace ofX, and let x G X. Then the following hold: 


(i) The shadow sequence {PAT"x)„^f^ converges weakly to some point in E = AD {B — g). 

(ii) No general conclusion can be drawn about the sequence {PBT"x)neK- 


Proof (i) After translating the sets A and B by a vector, if necessary, we can and do assume 
that A is a closed linear subspace of X. Using Lemma 2.2||^i)| we learn that (Vn G IN) PaT'^x = 
Pa{T’^x — ng). Note that E = A n (B — ^) C A. Now combine Lemma 2.2|(ii) - (M)] and 
Lemma 2.1 with C = E, and (x„)„g]N replaced by (T”x — (h) In fact, {PBT"x)„fz^ 

can be unbounded (see Example |2.4| or bounded (e.g., when A = B = X). ■ 


■ We use Nc to denote the normal cone operator associated with a nonempty closed convex subset C of X. 
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Example 2.4. Suppose that X = that A = R x {0} and that B = epi(|-| +1). Then 
A D B = 0 and for the starting point x G [—1,1] x {0} we have (Vn G {1,2,...}) = 

(0,n) G B and therefore ||PbT’”^I 1 = ||’T”^I1 = n —>• oo. 

Proof. Let x = (a, 0) with cc G [—1,1]. We proceed by induction. When n — 1 we 
have T(a,0) = 0 ) + PbRa{^,B) = Pb{o!., 0 ) = (0,1). Now suppose that for some 

(n G {1,2,...}) T"x = (0,n). Then = T(0,n) = P^±{0,n) + PBRA{0,n) = 

(0,n)+PB(0,-n) - (0,n + l) G B. ■ 


When B is an affine subspace, the convergence theory is even more satisfying: 

Theorem 2.5 (convergence of DRA when B is a closed affine subspace). Suppose that B is a 
closed affine subspace ofX, and let x G X. Then the following hold: 

(i) The shadow sequence {PaT"x)„^^ converges weakly to some point in E = An{B — g). 

(ii) The sequence {PbT"x)„^j^ converges weakly to some point in F = (A + ^) n B. 


Proof, (ii) Combine Theorem 2.2 i) and [51 Corollary 2.8(i)]. (i) Combine (ii) and 


Lemma 2.2|[iv) 


It is tempting to conjecture that Theoremremains true when A is just con vex and not 
necessarily a subspace. While this statement may be tru^ the proof of Theorem 
not admit such an extension: 


i) does 


Example 2.6. Suppose that X = R, that A = [1,2] and that B = {0}. Then g = and 
E = {!}. Letx = 4. We have (T'’x)„gN = (4,2,0,-1,-2,-3,...), PaT"x ^ 1 G £ and 
(Vn G {2,3,4,...}) T"x -ng = -(n-2) -n(-l) = 2 G A and Pa(T"x - ng) = 2 G A \ £. 
In the proof of Theorem |2.:^[[i)[ we had (P,?iT”x)„g]N = {Pa{T"x — ng))n^^ which is strikingly 
false here. 


3 Spingarn's method 

In this section we discuss the problem to find least-squares solutions of C;, i.e., to 

M 

find minimizers of ^ dh (7) 

;=1 

where Ci,..., Cm are nonempty closed convex (possibly nonintersecting) subsets of X with 
corresponding distance functions dQ, • • •, ^Cm- Now consider the product Hilbert space X : = 
X^, with the inner product ((xi,. . . ,Xm), (i/i, • • • ,i/m)) *—t We set 

A = {(x,...,x) G X ] X G X} and B = Ci x • • • x Cm- (8) 

^In Remark 3.14(ii)], the authors claim otherwise but forgot to list the assumption that A n B ^ 0. 
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Then the projections of x = (xi,..., x^) G X onto A and B are given by, respectively, Pa'X- = 
(m arid Pbx = (Pci^i,.. .,PcmXm)- Now assume that 


g = (^1^ • • • ^gM) ■= P^O G B - A. 


(9) 


Then we have 


M 


E := An (B - g) 7 ^ 0, and (x,... ,x) G A n (B - g) O x G f] (Cy - ^y). (10) 

M 

Using 111 Section 6], we see that the M-set problem 0 is equivalent to the two-set problem 

find least-squares solutions of A n B. (11) 

It follows from 0 and (10 ' that g is the unique vector in B — A that satisfies 


{Wi,W2,...,Wm) 7 ^ {gl,g2,---,gM), 
M 

and n (Cy — Wj) / 0 
/=i 


M 


M 


LHf > L\\gi\ 
;=1 ;=1 


( 12 ) 


We have the following result for the problem of finding a least-squares solution for the inter¬ 
section of a finite family of sets. 

Corollary 3.1. Suppose that Ci, ..., Cm closed convex subsets ofX. Let T = Id —Pa + PbPa, 
let X ^ X and recall assumption 0. Then the shadow sequence (PAT"x)„g]N converts to x = 
{x,... ,x) G A n (B — g), where x G ny^i(C/ “ gj) x is a least-squares solution of (Zl. 


Proof. Combine Theorem |2.3| with ( [T^ and ( [10] |. 


Remark 3.2. When we particularize Corollary |3.1| from convex sets to halfspaces and X is 
finite-dimensional, we recover Spingarn's lUTl Theorem 1], Note that in this case, in view of 
Ill Facts 5.1(ii)] we have g G B — A. Recall that Spingarn used the following version of his 
method of partial inverses from ITOl : 


(ao,bo) G A X A^ and (Vn G N) 


a'„ = PB(a„-Fb„), b'„ = eL„+b„-a'„, 


— Pa^u' 


’n+1 


= b;-PAb' 


(13) 


This method is the DRA in X, applied to A and B with starting point (ao — bo) (see, e.g., lH 
Lemma 2.17]). 
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